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We consider relative entropy in Field Theory as a well defined (non-divergent) 
quantity of interest. We establish a monotonicity property with respect to the 
couplings in the theory. As a consequence, the relative entropy in a field theory 
with a hierarchy of renormalization group fixed points ranks the fixed points in 
decreasing order of criticality. We argue from a generalized H theorem that Wilso- 
nian RG flows induce an increase in entropy and propose the relative entropy as 
the natural quantity which increases from one fixed point to another in more than 
two dimensions. 



1 Introduction 

This work is motivated by the old idea of irreversibility in the renormalization 
group (RG). Specifically, the existence of a function monotonic with the RG 
(a Lyapunov function for it) was proposed to ensure the existence of regular 
fixed ftoints as opposed to other possible pathological behavior, such as limit 
cyclesli As a sufficient condition for the existence of that function, one might 
have that the RG is actually a gradient dynamical system, that is, it derives 
from a potential, which is then the monotonic function. This type of RG flow 
would have further convenient properties. For example, it implies that the 
matrix that represents the linear RG near a fixed point (FP) is symmetric 
and hence it has real eigenvalues, to be identified with anomalous dimensions. 
Despite evidence — only perturbative and at low order — for the gradient flowP 
its existence remains inconclusive. 

However, in two dimensions a monotonic function has been found with 
the methods of conformal field theory, Zamolodchikov's C function. There 
have been many attempts to generalize thii.C' theorem to higher dimensions 
but they cannot be considered definitiveHtra Moreover, these authors have 
ignored Zamolodchikov's initial motivation, the adaptation of the renowned 
Boltzmann's H theorem to the RG setting. In a synthetic formulation we 
may quote this theorem as the statement that non-equilibrium (coarse-grained) 
entropy increases with time in the approach to equilibrium. Kadanoff block 
transformations as well as other coarse-graining formulations of the RG discard 
short-range information on a physical system and hence seem irreversible in a 
similar sense to the situations described by the H theorem, where the physical 
time is replaced by the renormalization group parameter. 
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In this spirit, we define a field theoretic entropy and study its properties, 
in particular, its possible divergences and its monotinicity. In a phase diagram 
with a multicritical point the entropy relative to it is finite and a monotonic 
function of the coupling constants spanning that diagram measured from that 
point. Therefore, this entropy is monotonic in the crossover from this point 
to another more stable multicritical point. It can be realized by a RG flow 
in which one or several relevant coupling constants become irrelevant. This 
is the typical situation that arises in field theoretic formulations of the RG. 
However, in coarse-grained or Wilson formulations the number of coupling 
constants is very large, as a consequence of the action of the RG itself, and 
they are classified as relevant or irrelevant only near the end fixed point. In 
analogy with the statistical mechanics of irreversible processes, we can then 
invoke a very general formulation of the H theorem due to E.T. Jaynes to show 
that the entropy increases in this more general context as well. 

This account is based on previous work on this subjectul 



2 Field theory entropy. Definition and properties 

Let us begin by recalling some concepts of probability theory. Given a proba- 
bility distribution {p m } one can define an entropy 

M 

S({Pm}) = - ^2 Pml0gp m . (1) 
m— 1 

For a continous distribution 

S[p(x)}=- { dxp(x)\ogp{x). (2) 



In this case is more a useful to define relative entropy with reference to a given 
distribution q(x) 

S[p(x)}= ( dxp{x)\og^\. (3) 

If q{x) is the uniform distribution this definition coincides up to a conventional 
sign and a constant with the previous one, now called the absolute entropy. 
However, it is more correct to take as reference a normalizable distribution, 
for example, the Gaussian distribution. 

Now we are ready to define an entropy in field theory. We begin with the 
usual definition of the generating functional or partition function 

Z[{\}} = e- w ^ = [ V[</>] e-W'Wl (4) 
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with W[{A}] the generator of connected amplitudes. If we write 

J VMe-W'W+WW =1, (5) 

we can consider 



V[<l>,{\}] =e- / [« A >]+ H ™ 

as a (family of) probability distribution of the stochastic variables <f). Therefore, 
the relative entropy is 

S[V,V ]=Tr[Vln{V/V )} 
= Jv[<p}(-I + Io + W-W )e- I+w = W-Wo-(I-I ) (6) 

with Iq a reference action of the same family, that is, with given values of the 
coupling constants. 

The typical form of the action is a linear combination of composite fields 
with their respective coupling constants, 

J[«MA}] = A a /a[# (7) 

We assume that only a part of the action I r is of interest to us. (We shall call 
it later relevant o crossover action for physical reasons.) We introduce a global 
coupling constant z for it or, in other words, we extract a common factor from 
the coupling constants in it, 

zI r =I-I . (8) 

Then we can express the relative entropy as the Lcgcndrc transform of W — Wo 
with respect to z: 

S re i = W(z)-W(0)-z^-. (9) 

Alternatively, it is the Legendre transform with respect to the couplings in I r , 
the relevant couplings l a , 

S rc i = W - Wo - l a d a W. (10) 

In turn the absolute entropy is the Legendre transform with respect to all the 
couplings. Both entropies have a simple description in perturbation theory: 
They are sums of n particle irreducible (nPI) diagrams with external composite 
fields at zero momentum. 

We have already remarked that for continuous probability distributions the 
relative entropy is well defined whereas the absolute entropy is not. In Field 



Theory, however, the stochastic variable is a field or. in other words, there is an 
infinity of stochastic variables that causes that the previous quantities are not 
necessarily well defined. This is the well known problem of divergences, either 
ultraviolet (UV) or infrared (IR). If we assume that the field theory under 
study is regularized by defining it on a finite lattice, we return to the case 
of a finite number of (continuous) stochastic variables and W as well as the 
relative entropy are well defined. Then the first limit we have to consider is the 
infinite volume or thermodynamic limit, as is usual in Statistical Mechanics. To 
perform the limit one has to define specific quantities — per lattice site or unit 
volume — that remain finite. Nevertheless, at the critical point some of them 
may diverge, as occurs to the specific heat. We speak of an IR divergence. In 
or ( [Tof ) the possible IR divergences of the relative entropy are in the sum 
of (f a ) and hence it is IR finite in d > 2. 

The second and more important limit is the continuum limit, which allows 
to define a field theory as the number of lattice points per unit volume goes 
to infinity. Since W per lattice site is finite, the relevant quantity now, W per 
unit volume, diverges as a~ d , with a the lattice spacing and d the dimension. 
This is a UV divergence, closely related with the divergent ground state en- 
ergy in Quantum Field Theory, which is substracted by taking the composite 
operators normal ordered. Fortunately, the a~ d divergence of W is cancelled 
in the Legendre transform (^) that gives the relative entropy by substracting 
W(0). Furthermore, the next-to-leading divergence a~ d+2 cancels in the sub- 
straction of z^-. Therefore, in dimension d < 4 the relative entropy is UV 
finite. Notwithstanding this, we know that if we calculate nPI diagrams in 
perturbation theory we shall find UV divergences. These divergences pertain 
exclusively to perturbation theory and are removed by renormalization of the 
coupling constants. Quantities expressed in terms of physicial (renormalized) 
couplings show no trace of perturbative divergences. 

2. 1 Monotonicity of the relative entropy 

From the expression of the relative entropy as a Legendre transform (^) we 
obtain 

dS dW d ( dW\ d 2 W d. T , . .,. , r . 2 , 

-j- = —j -j- z— = -z-TY- = ~z—(I r ) = -z(-{I?) + (I r ) 2 ). (11) 

dz dz dz \ dz J dz A dz 

Then we have the positive quantity 

z^-=z 2 {(I r -{I r )) 2 )>0, (12) 
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which proves that the relative entropy is a monotonic function of \z\. Moreover, 
((I r - (I r )f) = t((f a (/„»(/„ - (/„))) l». (13) 
Hence the matrix 

Qab = ((.fa - (fa))(h ~ (h))) = " (14) 

is positive definite, implying that W(l a ) is convex. This matrix is generally 
defined in probability theory, where it is called the Fisher information matrix 
and provides a metric in the space of distributions. 

There is a similar convexity property for the relative entropy as function of 
its natural variables, the expectation values of composite fields, S((f a }); since 



d 2 S _ dl a fd(f b )\ ( d 2 W 



d(fa)d(f b ) d(f b ) V di° J \di*di» 



tab ' 



,\ (15) 



the matrix of second derivatives of the entropy is the inverse of Q and hence 
positive definite as well. Summarizing, the key properties of the entropy arc 
its monotonicity with z, therefore, any coupling, and its convexity in the space 
of composite fields (f a ). 



3 Crossover between field theories 

The situation we consider is when the action / is associated with some mul- 
ticritical point and there is crossover to another lower multicritical point. 
Crossover signifies a change of the type of critical behaviour or universality 
class, with a change of critical exponents or any other quantity pertaining to 
it. Then Iq refers to the critical action at the first point and I r contains the 
relevant coupling constants. The way in which a crossover occurs is illustrated 
by the action of the RG: Its flow will lead away from the first point asymptot- 
ically to a region of the phase diagram of lower dimensionality, where one or 
more couplings become irrelevant and dissapear. 

We will restrict our considerations in what follows to scalar ILi symmetric 
field theories in 2 < d < 4 with polynomial potentials and non symmetry 
breaking fields. For illustration, we will discuss some exact results pertaining 
to soluble statistical models, which illuminate the behaviour of the field theories 
in the same universality classes. 
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3.1 The Gaussian model and the zero to infinite mass crossover 

As an elementary example we take the Gaussian model, given by the action 

m = I M {l {d ^ )2 + r 2^}- (16) 

Here the relevant coupling is r. Its critical value is r c = 0. Hence the crossover 
parameter is also r and the end fixed point for large r is the infinite mass 
Gaussian model. 

The Gaussian model is soluble in any dimension by dixect functional inte- 
gration. The lattice version with coupling [3 = 1/T yields 

wm= \L^t in { i ' w ^ cosk ^ (i7) 

per site. The continuum limit is performed by redefining momenta as k = ap 
and considering W per unit volume. Since k belongs to a Brillouin zone, 
— oo < p < oo. It is straight forward to check that the UV divergences are as 
announced in the previous section and cancel in the relative entropy. 

3.2 Ising universality class 

Let us next consider the Ising model on a rectangular lattice. For simplicity we 
will restrict our considerations to equal couplings in the different directions. 
Since the random variables here (the Ising spins) take discrete values it is 
natural to consider the absolute entropy. This model, as is well known, admits 
an exact solution in two dimensions for the partition function!!! which yields a 
W per site 

1 r d 2 k 

W lfi] = o / 2 ln [cosh 2 (2/3) - sinh(2/3)(cos k x + cos k y )] . (18) 

The entropy is then 

as plotted against (3 in figure la. The monotonicity of the entropy turns to 
convexity when it is expressed in terms of the internal energy U = as can 
be seen in figure lb. 
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Fig. la and lb: The entropies S a (/3) and S a (U) for the 2d Ising model 
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Fig. 2a and 2b: The relative entropies S((3,(3*) and S(U, U*) for the 2d 

Ising model 



Now, of course, we can also consider relative entropy in this setting. To fa- 
cilitate comparison with a field theory it is natural to choose entropy relative 
to the critical point (CP) lattice Ising model. This is also natural since the 
critical point is a preferred point in the model. This relative entropy is given 
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We have plotted this in figure 2a. We see that it is a monotonic increasing 
function of |/3 — (3*\ and is zero at the critical point. In figure 2b we plot this 
entropy as a function of the relevant expectation value, the internal energy 
U = and set the origin at U*, the internal energy at the critical point. 
Naturally, the graph is convex. 

In the continuum limit the absolute entropy or W per unit volume are 
UV divergent but the relative entropy is finite, like in the Gaussian model. In 
fact, W is similar in both models when expressed in terms of the mass of the 
particles, although the relation of the mass with the coupling constant is very 
different in each case, of course. 

In more than two dimensions the Ising model has not been solved exactly. 
Its critical behaviour is in the universality class of a <p field theory, 



We restrict our considerations to d < 4 where the theory is super-renormalizable 
The CP occurs for r c such that the correlation length is infinite, with some ar- 
bitrary but fixed value of the bare coupling constant A. These are the reference 
values for the relative entropy. Since the squared mass r is a function of the 
Ising coupling (3, going off from (3 C induces crossover: This is the crossover line 
from the Wilson Fisher fixed point to the infinite mass Gaussian fixed point. 
Now we can apply the previous monotonicity theorem with z — r — r c . Since 
A is relevant in d < 4, one can place it into the crossover portion of the action. 
This provides us with another crossover and in this more complicated phase 
diagram there are in fact two Gaussian fixed points: A massless and an infinite 
mass one, both associated with A = (see the article by Nicoll et alQ for a 
description of the total phase diagram). The crossover between them is that 
associated with the Gaussian model as described above. 

3.3 The universality class of the tricritical model 

We consider now models with a tricritical point (TCP), namely, with a phase 
diagram where three critical lines meet at a point and three phases become 
critical simultaneously. The universality class of those models is a field theory 




(19) 
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with a sixth degree coupling, with action 

/[<MA(2)}]= /^{^W) 2 + ^ 2 + ^ 4 + |^ 6 } (20) 

This field theory is superrenormalizable for d < 3. The TCP occurs for r tc and 
X tc such that the correlation lengths of the two order parameters 4> and (j) 2 are 
infinite, with some arbitrary but fixed value of the bare coupling constant g. 
These are the reference values for the relative entropy. 

Now we have various possible crossovers. If g is held fixed the relevant 
variables are t — r~r tc and I = A — A tc - First consider the line formed setting 
I = and ranging t from zero to infinity. This is a line leaving the tricritical 
point and going to an infinite mass Gaussian model. Similarly we can consider 
the line t = and I ranging through different values. If A is held at its critical 
value one sweeps a critical line and crosses over to the Wilson-Fisher fixed 
point. According to the monotonicity theorem we have again that the relative 
entropy is a monotonic function in these crossovers. 

A more thorough analysis of the structure of the phase diagram pertinent 
to these crossovers can be done in terms of the shape of RG trajectories. They 
can be easily obtained near the TCP from the linear RG equations as t — cl v 
for various c, with only one parameter given by the ratio of scaling dimensions 
of the relevant fields ip = ^ > 1, called the crossover exponent. These curves 

have the property that they are all tangent to the t axis at the origin and any 

i 

straight line t = a I intersects them at some finite point, k = (a/c)*- 1 and 
ti = ali- For any given c the values of and tj increase as a decreases and 
go to infinity as a — > 0. This clearly shows that the stable fixed point of the 
flow is on the line at infinity and, in particular, its projective coordinate is 
a = 0. The point a = oo on the line at infinity is also fixed but unstable. In 
general, as the overall factor z is taken to infinity we shall hit some point on 
the separatrix connecting these two points at infinity. 

We recognize here a feature of the type of crossover phase diagrams that 
we study: In a coordinate system defined by the linear RG (usually called 
system of nonlinear scaling fields) near the highest multicritical point the re- 
maining fixed points are located at infinity. To study the crossover, when a FP 
is at infinity, we need to perform some kind of compactification of the phase 
diagram. Thus, we shall think of the total phase diagram as a compact mani- 
fold containing the maximum number of generic RG FP. This point of view is 
especially sensible regarding the topological nature of RG flows. Furthermore, 
thinking of the RG as just an ODE indicates what type of compactification 
of phase diagrams is adequate: It is known in the theory of ODEs that the 
analysis of the flow at infinity and its possible singularities can be done by 
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completing the affine space to projective spaceu This is also appropriate for 
phase diagrams. 

The projective compactification lends itself to an interesting physical in- 
terpretation. In the tricritical action, for example, we can consider the set 
of couplings r, A and g as a system of homogeneous coordinates in the real 
projective space KP2 ■ Holding g fixed is equivalent to taking the patch of IRP2 
appropriate to the TCP, with affine coordinates r/g and X/g. (We may set 
g=l, say, where we now use dimensionless couplings, the original <?, which 
we now label gB, setting the scale.) Following the RG trajectories, in the IR 
limit gn becomes independent of its initial value and eventually goes to zero, 
as illustrated by the solution of the one-loop RG equations, 

= 9B 
9R 1 + a(d) g B R 3 ~ d 

with R the IR cutoff and a(d) a dimension dependent factor. This is the 
physical reason why the other FP are at infinite distance of the TCP and one 
must take a coordinate system with g — or, in mathematical terms, choose 
another coordinate patch in HP2. 



4 Wilson's RG and H theorem 

A Wilson RG transformation is such that it eliminates degrees of freedom of 
short wave length and hence high energy. Typical examples are decimation 
or block spin transformations. It is intuitively clear that their action discards 
information on the system and therefore must produce an increase of entropy. 
Indeed, as remarked by Mat3 iterating this type transformation does not con- 
stitute a group but rather a semi-group, since the process cannot be uniquely 
reversed. In the language of statistical mechanics we can think of it as an 
irreversible process. 

We illustrate Wilson's RG by a very simple example, the Gaussian model 
of subsection 3.1 with cut-off action 

1=1 ^ d d p^(p) (p 2 +r) <j>{-p), (21) 



which yields 



2 J (2*)* 



P 2 



A 2 



(22) 



The corresponding relative entropy 
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is finite when A goes to infinity and vanishes for t = 0. The differential Wilson 
RG is implemented by letting A run to lower values. Let us see that S is 
monotonic with A. 
We have that 

dS _ A^ 1 / A 2 + r t 
dA ~ 2 d iri r(d/2) \ A 2 + r c A 2 + r 

except for an irrelevant constant. With the change of variable x = A 2 , we have 
to show that the corresponding function of x is of the same sign everywhere. 
Then we want 

x + r r — r c 
In 

x + r c x + r 

not to change sign. Interestingly, the properties of this expression are inde- 
pendent of x somehow for if one substitutes in In p — the value p = ^f_+f 

then one recovers the entire function. Now it is easy to show that In p > 1 — - . 
(The equality holds for p — 1 — the critical point.) 

This proof resembles the classical proofs of H theorems. Boltzmann's H 
theorem (H — —S of (j|)) states that the coarse-grained entropy of a rarefied 
gas, described by its one-particle statistical distribution f(r,p), increases as 
the gas evolves to its Maxwell-Boltzmann equilibrium distribution, where j± 
remains constant, effectively making this evolution an irreversible processus 
His proof uses the expression for % given by the kinetic equation that takes 
into account collisions between particles. However, the negativity of =§• is 
ultimately due to the positivity of the function (x— 1) lnx, in a similar fashion 
to the proof in the previous paragraph. 

For general far-from-equilibrium processes a description in terms of differ- 
ential equations (with respect to time) is not available. A typical irreversible 
process is, for example, the one that takes place when the partition which ther- 
mally insulates two parts of a container with different temperature is suddenly 
removed. The container (the total system) passes through states which cannot 
be regarded as thermo dynamical states, that is, described by a small number 
of variables, until it reaches a new equilibrium state where the temperature is 
well defined and any trace of the initial values in the two parts is lost. The 
important point is that, since the entropy is a state variable, its increase is 
independent of the details of the process and one can assume a quasi-static 
process for convenience. 

We can think of the action of Wilson's RG in this manner: typically its 
action introduces new couplings and eventually their number is not bound 
and the description in terms of the original Hamiltonian is no longer useful. 
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However, when a FP is approached the number of couplings reduces again, in 
fact to a smaller number than the initial one since some information is neces- 
sarily lost: A relevant coupling must become irrelevant in the process. Here 
too it may be convenient a description of the process, a crossover, by quasi- 
equilibrium states, such as is provided by the Field Theory picture presented 
in the previous section. However, to independently establish the increase of 
entropy we can ressort to the very general formultion of the H theorem pro- 
vided byJaynes in the form of what has been called the maximum entropy 
principles 

In Jayne's maximum entropy principle H is a function(al) of the prob- 
ability distribution of the system that measures the information available to 
the system and has to be a minimum at equilibrium. To be precise, the actual 
probability distribution is such that it does not contain information other than 
that implied by the constraints or boundary conditions imposed at the outset. 
The simplest case of the H theorem is when there is no constraint wherein H 
is a minimum for a uniform distribution. This is sometimes called the principle 
of equiprobability. This is the case for an isolated system in statistical mechan- 
ics: all the states of a given energy have the same probability (micro-canonical 
distribution). Another illustrative example is provided by a system thermally 
coupled to a heat reservoir at a given temperature where we want to impose 
that the average energy takes a particular value. Minimizing H then yields 
the canonical distribution. 

In general, we may impose constraints on a system with states Xi that the 
average values of a set of functions of its state, f r (Xi), adopt pre-determincd 
values, 



with Pi := ELXi). The maximum entropy formalism leads to the probability 
distribution 



The A r are Lagrange multipliers determined in terms of f r through the con- 
straints. In field theory a state is defined as a field configuration <p(x). One can 
define functionals of the field J- r [<p{x)\. These functionals are usually quasi- 
local and are called composite fields. The physical input of a theory can be 
given in two ways, either by specifying the microscopic couplings or by specify- 
ing the expectation values of some composite fields, (T r [4>(x)]) . The maximum 




(25) 




(26) 
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entropy condition provides an expression for the probability distribution, 



P[<f>(x)} = Z- 1 cxp ^- £ \ r FMx)]j , (27) 
and therefore for the action, 

/ = ^A r ^ r ; (28) 

r 

namely, a linear combination of relevant fields with coupling constants to be 
determined from the specified (T r ). If a constraint is released, namely, the 
information given by the expectation value of a composite field is lost, the 
system evolves — crosses over — to a more stable state with larger entropy. Its 
probability distribution is again of the form ( p7| ) but with one less term in the 
sum, the irrelevant field that has dissapeared. 



5 Conclusions 

We have shown that the relative entropy is the natural definition of entropy in 
Field Theory; namely, this relative entropy is well defined, that is, free from 
divergences, as opposed to the absolute entropy. It is then the appropriate 
quantity to study crossover between field theories. 

We have established a theorem of monotonicity of the relative entropy 
with respect to the coupling constants. Thus it provides a natural function 
which ranks the different critical points in a model. It grows as one descends 
the hierarchy in the crossovers between scalar field theories corresponding to 
different multicritical points. 

We have further established that the phase diagrams of the hierarchy of 
critical points are associated with a nested sequence of projective spaces. It 
is convenient to use coordinates adapted to a particular phase diagram in the 
hierarchy. Hence a crossover implies a coordinate change. The transition from 
bare to renormalized coordinates provides a method of compactifying the phase 
diagram. 

We discussed the action of the Wilson RG and argued that the relative 
entropy increases as more degrees of freedom are integrated out. Although a 
differential increase may be hard to get in general due to the proliferation of 
couplings, Jaynes' formulation of the H theorem allows us to conclude that 
the entropy increases globally in a crossover. 

This study was motivated by the search for a monotonic function along 
the RG trajectories, like the C function given by Zamolodchikov's theorem in 
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two dimensions. Thus we owe a comment to the connection with this theorem. 
The field theoretic relative entropy is a well defined and useful quantity on its 
own, as we have shown. Since we restricted the dimension to d > 2 a direct 
comparison with the C function is not possible. Given that the C function 
is built from correlation data, .unlike the relative entropy, they do not seem 
related. However, recent worko relates the central charge with a particular 
type of entropy, the geometrical entropy. Undoubtedly, this connection needs 
to be further investigated. 
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